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Summary;  A  general  continuous  time  congestion  process  is  defined  on  a  finite 
number  a£   independent  sequences  of  i,i,d  random  variables  and  routing  pro- 
babilities.  After  examining  transitions  in  a  small  time  interval,  attention 
is  focused  on  an  iterative  calculation  which  is  interpreted  as  a  discrete 
time  Markov  process. 
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From  a  qualitative  point  of  view  a  single  channel  queue  should  provide  an 
approximation  of  the  congestion  in  a  system  in  which  homogeneous  customers 
are  processed  by  an  organization  of  specialized  servers..   On  the  other  hand, 
investigating  simple  processing  systems  can  expand  understanding  of  simple 
queues.  When  a  system  can  work  on  several  jobs  simultaneously,  the  times 
between  service  completions  during  a  busy  period  can  be  considered  as  service 
times  for  successive  customers  in  a  single  server  system.   These  times  are 
likely  to  be  correlated.  With  this  interpretation  a  processing  system  model 
provides  an  interesting  and  potentially  useful  generalization  of  the  usual 
single  server  models.   The  relationship  between  single  server  and  processing 
systems  can  be  made  quantitative  through  the  study  of  a  class  of  network 
models . 


Event  Structure 

The  single  channel  queue  is  modeled  by  a  stochastic  process  based  on  the 
arrival  and  service  events.   The  generalization  discussed  here  can  still  be 
defined  in  terms  of  events  which  cause  discontinuities  in  the  congestion 
process.  The  innovation  is  that  here  there  will  be  a  finite  number,  k*,  of 
event  types.   Each  event  of  each  type  is  proceeded  by  an  interval  of  time. 
These  times  form  k*  independent  sequences  of  i,i,d  random  variables.   As  in 
the  single  channel  system,  the  occurance  of  an  event  may  start  any  number  of 
intervals.   Again  an  arrival  always  starts  a  new  interarrival  interval  so 
that  there  is  always  at  least  one  interval  in  process.   In  these  systems  it 
is  desireable  to  introduce  a  new  possible  effect  of  an  event.  This  is  that 
an  event  of  one  type  may  in  appropriate  circumstances  cause  an  interruption 
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in  the  interval  associated  with  another  type  of  event.   In  the  language  of 
priority  systems  the  interruption  may  result  in  the  resumption  of  the  interval 
at  some  later  time  or  it  may  cause  th  repetition  of  thrt  part  which  has 
already  elapsed.  Although  more  stringent  than  necessary,  a  convenient  and 
useful  assumption  is  that  the  occurance  of  an  event  cannot  shorten  any  of 
the  intervals  which  are  in  process  except  by  cancelling  the  coming  event 
entirely.   Under  this  assumption  the  number  of  events  of  each  type  i  in  any 
interval  of  time  T  is  not  greater  than  one  plus  the  minimum  number  of  intervals 
of  type  i  whose  sum  is  greater  than  T.   Summing  over  the  k*  types  of  intervals 
provides  an  upper  bound  on  the  number  of  events  in  X .   To  ensure  that  there 
are  no  technical  difficulties  in  constructing  probability  relationships,  it 
is  desirable  to  insure  that  this  bound  is  finite  with  probability  1.  An 
assumption  which  guarantees  this  is  that  there  is  some  £  >  0  such  that  the 
distribution  function  of  the  i  th  interval  type  satisfies  F   (e)  <  a  <  1. 

A  further  assumption,  which  helps  to  simplify  the  construction  of  these 
processes  and  is  not  very  restrictive,  guarantees  that  for  a  small  At  at  most 
one  event  occurs.   If  an  interval  of  each  type  is  in  process  at  time  t  then 

the  probability  of  two  or  more  events  occurring  in  At  is 

k*  k*        k* 

p(At)  =  1  -  tt   (1-H.  (£,))-  Z    [H.(£.)  IT  (1  -  H,(£.)] 
i-1     L   L    1=1   X   i  j=l      3      J 

where  L  is  the  time  since  the  start  of  i  th  interval  and  H  (£.)  is  the  con- 
ditional probability  that  an  interval  of  type  i  will  terminate  in  an  interval 

of  length  At  given  that  it  has  not  terminated  in  [0,£.] 

dF.(f.) 


where  dF . (?. )  is  the  probability  that  an  interval  of  type  i  will  end  in 
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[E,   ,£+At].  Assuming  that  the  interval  distributions  have  continuous  density 
functions  implies  H. (£  )=h  (£  )At  and  the  probability  of  two  or  more  events 
becomes  o(At).   Thus  the  probability  that  the  congestion  process  has  at  most 
one  event  in  any  small  interval  of  time  At  can  be  made  as  close  to  1  as  one 
wishes  by  choosing  At  sufficiently  small.   The  probability  of  an  event  of 
type  i  is  h.(C.)At  to  this  same  level  of  approximation.   These  same  conclusions 
hold  for  the  processess  which  are  in  operation  when  there  are  fewer  than  k* 
of  them.   Since  the  arrival  process  always  operates  there  will  always  be  at 
least  one  interval  in  process  at  any  time. 

These  assumptions  and  conclusions  should  not  be  a  surprise.   As  with 
the  special  case  of  2  event  systems,  these  processes  depend  on  event  sequences. 
With  probability  1  only  a  finite  number  of  events  occur  in  any  finite  interval 
and  at  most  one  occurs  in  any  interval  of  time  which  is  sufficiently  small. 
For  the  special  case  of  k*=2,  examining  the  congestion  only  at  the  occurrance 
times  of  one  type  of  event  provides  important  simpliciations  in  analysis. 
As  k*  increases  the  significance  of  semi-Markov  process  analysis  decreases 
dramatically. 

Routing 

In  the  single  channel  queue  the  changes  which  occur  at  arrival  and 
service  completion  events  are  easy  to  describe.   This  is  not  the  case  in  more 
general  processing  systems.   Jobs  do  not  remain  homogeneous  in  such  systems 
but  become  distinguished  as  various  service  tasks  are  performed  upon  them. 
Thus  general  systems  automatically  acquire  some  of  the  characteristics  of  prior- 
ity systems.   One  concept  of  a  general  congestion  process  is  that  jobs  change 
priority  after  each  service  operation  and  each  free  server  starts  work  on  the 
job  with  the  highest  priority  among  those  on  which  he  can  work.  This  also 
raises  the  possibility  of  jobs  preempting  servers  which  is  the  reason  for 
considering  interruption  of  the  intervals  to  the  next  event  of  various  types. 
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For  this  discussion  only  a  finite  number  of  priority  classes  will  be  allowed. 
Moreover,  any  event  can  change  the  priority  classification  of  only  one  job. 
For  effective  analysis,  the  change  in  priorities  must  be  Markovian  i.e. 
depend  only  on  the  congestion  at  the  time  of  a  change.   The  variety  of  change 
processes  which  can  be  considered  depends  on  how  the  states  of  the  congestion 
process  are  defined.   If  the  lengths  of  the  intervals  in  progress  are  included, 
an  interesting  possibility  is  that  priority  is  determined  by  the  length  of 
time  spent  in  the  service  operation  just  completed.   This  is  used  to  classify 
short  and  long  jobs  in  computing  systems.  A  job  which  requires  an  i.o.  device 
before  finishing  a  quantum  of  cpu  time  is  considered  short  while  one  which 
does  not  is  classified  as  long.   Such  a  classification  proceedure  does  not 
complicate  the  models  discussed  here  since  to  be  Markovian  the  congestion 
process  requires  supplementary  variables  describing  the  time  since  the  start 
of  the  current  interarrival  interval  and  all  services  currently  in  progress. 
Thus  appropriate  information  for  the  priority  change  is  included  in  the  Markov 
process  describing  congestion. 

An  alternative  terminology  for  describing  the  effects  of  events  is  the 
concept  of  a  routing  process.   This  was  the  approach  of  J.R.  Jackson  [4]  in  his 
pioneering  paper  on  queueing  networks.   He  assumed  that  there  was  a  queue  assoc- 
iated with  each  of  the  servers  in  the  system.  When  a  server  completed  a  task 
he  started  on  the  next  job  in  his  queue.   The  job  which  he  had  just  finished 
went  to  any  of  the  queues  or  left  the  system  according  to  probabilities  which 
depended  only  on  which  server  had  finished  work  on  the  job.   Arriving  jobs 
went  to  their  first  queue  according  to  a  fixed  set  of  probabilities.   Jackson 
called  this  Markov  routing.   The  models  considered  here  will  retain  the 
Markov  property  but  allow  the  probabilities  of  transfers  to  depend  on  the 
service  time  of  the  service  just  completed  or  more  generally  on  the  elapsed 


-5- 

times  of  all  intervals  in  process.   In  addition,  it  is  possible  to  have  one  or 
more  servers  serving  one  or  more  queues.   In  some  cases  several  servers  may 
work  on  the  s.nne  job  simultaneously.   In  addition  whether  a  free  server  begins 
work  or  not  will  be  allowed  to  depend  on  the  current  level  of  congestion  in 
the  system.   Thus  a  server  who  has  a  job  waiting  for  his  attention  may  remain 
idle  because  of  excessive  congestion  elsewhere  in  the  system. 

Congestion  Process 

The  congestion  process  to  be  developed  here  measures  the  number  of  jobs 

in  k  different  catagories  in  the  system  in  continuous  time.   Thus  it  is  a  k 

dimensional  vector  valued  stochastic  process  N(t)  with  non  negative  interger 

coordinates.   Since  changes  only  occur  when  events  occur  it  can  be  assumed  that 

N(t)  is  continuous  from  the  right  i.e.  limit  N(t)  =  N(t)  when  T  decreases  to 

t.   This  process  is  generally  not  Markovian  but  becomes  Markovian  if  a  k* 

dimensional  vector  valued  supplementary  variable  W(t)  is  added.   The  coordinates 

of  W(t)  measure  the  elapsed  time  of  the  intervals  in  process.   The  set  of 

values  of  N  and  W  may  be  restricted  in  any  coordinate  to  a  finite  range.   As 

long  as  arrivals  and  service  operations  involve  single  jobs,  then,  if  there 

can  be  i  jobs  of  type  j  in  the  system  at  a  given  time,  at  some  previous  time 

there  must  have  been  i-1  jobs  of  type  j  in  the  system.   Similarly  if  w  is 

a  possible  time  for  the  elapsed  interval  of  type  j  then  all  smaller  times  must 

have  occurred.   Thus  in  both  cases  any  restriction  of  the  coordinates  of  N, 

W  must  be  to  an  interval. 

When  N(t)  =  n  assume  that  there  is  a  set  S  of  the  integers  [l,k*]  which 

n 

identifies  the  types  of  intervals  which  are  in  process.  Let  e   be  a  vector 

n 

with  a  1  in  coordinate  k  if  k  £  S   and  a  0  if  k  t   S  .   If  no  interval  ends  in 

n  n 

At  then  W(t+At)  =  W(t)  +  At  e   .  With  probability  h.(w)  At  an  interval  of 

Sn  X 

type  i  terminates  in  (t,t+At).   If  N(t) ,  W(t)  =  n,w,  there  is  a  transition 
from  n,w  to  n',w',  according  to  the  routing  probabilities  u  (n',w'|n,w).   It  is 


.•-•<' 
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assumed  that  there  are  a  finite  number  of  these  conditional  probabilities  and 

that  they  sum  to  1  and  that  they  are  continuous  from  the  right  in  w.   Since 

the  routing  fro cess  changes  the  location  or  classification  of  a  single  job 

all  these  transitions  are  of  the  nearest  neighbor  variety.   Thus  y.(n',w'|n,  w) 

is  zero  for  all  n'  for  which  |n'-nj  >  1  where  the  norm  is  the  maximum  absolute 

value  of  the  coordinates.   Again  w"  =  w  +  At  e„   although  with  some  exceptions. 

n 

First  the  i  th  coordinate  of  w'  must  be  zero  since  this  type  of  interval  ended. 

Other  exceptions  occur  when  there  is  a  premption  or  there  is  a  cancellation. 

In  this  case  some  coordinate  wT,  i  ^  i  will  be  either  w.  or  0.   This  defines 

J  3 

the  infinitesimal  generator  and  therefore  the  transition  function  of  the 
congestion  process [2] . 

Transition  Probabilities 

More  interesting  than  the  formula  for  the  transition  probabilities  in 
terms  of  the  infinitesimal  generator  is  an  alternative  which  explicitly  uses 
the  event  structure.   The  transition  probabilities  can  be  represented  in  terms 
of  two  simple  operators.   The  first  is  the  no  event  operator  T   (t)  defined  by 

1  -  F.(t+w.) 

fils  1  -  F.(w.l  if  wT  =  t  +  w.   ieS 

I    n      l  i  i        in 

T°(t)(n,w,w")  =  i  .._ 

/  w.  =  w.      it S 

/  i    l        n 

-  0  otherwise 

The  second  is  the  one  event  operator  T  (t)  defined  by 

1  f1(t+w1)dt     1  -  F  (t+w  ) 

T  (t)(n,w,n',w')  =  Z  y  (n',w',n  ,w+tes  )  '    _  ?X,      ;■■  it  x  _  F  /w  \ 

ieS  n         i;  jeS     j  j 

n  n 
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This  function  is  the  probability  of  a  transition  from  n,  w  at  0  to  n",w"  at 

some  time  in  the  interval  t,t+dt.   Using  the  continuity  from  the  right  of 

the  routing  probabilities,  this  can  also  be  considered  the  probability  of 

a  transition  from  N(0)  =  n,  W(0)  =  w  to  N(t)  =  n',W(t)f.(w',w'+dtes  ).   In 

n' 

addition,  the  elapsed  time  of  any  interrupted  intervals  is  specified  only  to 
an  accuracy  of  dt. 

The  probability  of  a  two  event  transition  n,w  to  a  state  n%w'  with  the 
second  event  occuring  at  t  is 

T2(t)(n,w,n',w')  =   fV   f    .  I^s)  (n,w,n*,w*)T1  (t-s)  (n*,w*,n',w') 

o  w^n* 

The  sum  only  involves  a  finite  number  of  terms  corresponding  to  possible  events 

at  time  s.   The  intergrals  are  somewhat  deceptive  because  not  all  values  of  w* 

have  positive  probability.   To  make  a  positive  contribution  w*  must  satisfy 

w'  =  w*  +  (t-s)  e    except  for  the  coordinates  which  become   0  in  the  transi- 

n* 
tion  from  n*  tc  n'.   The  result  may  be  only  the  sum  of  a  finite  number  of 

products  of  terms,  each  of  which  is  proportional  to  dt.   The  appropriate  inter- 
pretation here  uses  both  the  approximation  in  space  and  time.   Thus  the  result 
will  be  considered  proprotional  to  dt  times  the  product  of  inf initessimals  dw. 
for  those  values  of  i  for  which  intervals  either  start  or  are  interrupted  at 
times  s.   On  the  other  hand,  the  event  at  s  may  lead  to  a  new  state  n*  in  which 
no  intervals  are  interrupted  and  no  new  intervals  are  begun.   In  this  case 

S  .  CT S   and  the  intergral  includes  non  zero  terms  for  all  s  in  (o,t). 
n*    n 

2 
The  definition  of  T  (t)  can  be  used  recursively  to  define 

Tk(t)(n,w,n',wO  =  f*   f^L^^ts)  (n,wJn*,w*)T1(t-s)  (n*,w*,n',w') 


k 
Eventually  all  of  the  initial  intervals  terminate  and  T  (t) (n,w,n ,w') 

becomes  a  function  proportional,  to  dt  til      dw.  for  i  e   S  _  or  the  i  th 

n 

type  interval  is  suspeivi      n" .      To  simplify  later  expressions  the 
integrations  over  the  state  variables  will  be  symbolized  by  T   x(s)  *  T  (t~A) 


so  that 


Tk(t)  =  /*  Tk  1(B)*T1(t-s) 


Now  define 


H°(t)  (n,w,n',wO  =  T°(t)(n,w 


H  (t)(n,w,n',w')  =  ^  f       Tk(s)(n,w,n',w*)  T°(t-s)  (n',w*  ,w') 

o  w* 


In  the  more  concise  notation 


Hk(t)  -  St   Tk(s)  *  T°(t-s) 


This  family  of  functions  give  the  probability  of  a  k  event  transition  from 
n,w  at  o  to  n'  and  approximately  w"  at  time  t. 

Since  with  probability  1  only  a  finite  number  of  events  occur  in  a  finite 
time  the  probability  of  a  transition  from  n,  w  at  o  to  n   and  approximately  w' 
at  t  must  be 

CO 

S  Hk(t) 
k=0 

This  is  a  conservative  transition  function  i.e.  the  sum  over  all  states  at 
time  t  is  1.   It  satisfies  the  differential  equation  defined  by  the  infinit- 
essimal  generator. 
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Example 

Before  justifying  the  last  two  statements,  consider  the  process  of  this 
type  for  an  M/K/i  queue.   The  Le  non  negative  integer  variable 

and  two  supplementary  variabL  >r  elapsed  interarrival 

and  service  times  respect:; 


T(t)(n,w,w') 


/  e 


-Xt 


■(X+i 


n=0    w^O    w2=0 

w^w  +t  w'=0 

n>0    w  >0    w2>0 


w_=w  -H:  w„=w?+t 


otherwise 


dt 


n=0,  w  >0,  w2=0 
w=l,  w'=0,  w2=0 


T  (t) (n,w,n',w 


l>Cdt 


n>0,  w  >0,  w„>0 

:i '"=,'.+!  w'=0  w^=w2+t 


. 


n>0   w  > 0    w2>0 


n'=n-l   <=w.,-l-t  w*«0 
1  J      L 


otherwise 


In  space  terras 
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Ae   dw. 


Xe^^dw, 


T  (t)(n,w,n',w")  - 


n=0    w  > 0    w  =0 


n'=l   w^-Q  w~=0 


n>0    w  >0    w  >0 


n"=r:+i  w  =0    w7=w?+t 


-(A+u)t, 
ye       dw, 


n>0    w  > 0    w  >0 


n  =n-l  w  =w  +t  w^-0 


otherwise 


The  special  case  of  n=l,  n"=o  and  the  termination  of  a  service  event  produces 
exactly  w'=o  not  w'  in  o,dw^  since  a  new  service  interval  is  not  started. 


Next 


/*  ■,  -At  -ywi" ,  ,  . 
/Ape   e    -cltdw, 


n=0 


w  >0    w  =0 


n  =0   w  =w  +t  w  =0 


,2  -Al  -uwo  .   ,  , 
.  e       Mtdw., 


n=0 


w  > 0    w  =0 


n  =2   w,-0    t>w  >0 

.L  i 


-e    )Gt 


n=l 


w  >0    w2_>0 


n"=l   w  "-0       w^O 


T  (t)(n,w,n',w*) 


>  -(A+u) t . 

Aue    ^'    at  dw. 


,2   -(X+u)t. 
a  te     '  at 


n>l 


n>l 


w  ^> 0    w2_>0 


n"=n   t^wf^P  w2=(^ 


w  > 0    w„>0 


n  =n+2  w  =0    w?=w-+t 


\ 
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p2te~'    !tdt        n>2    w  >0    w  >0 


"2- 


n'=n-2  w.T=w,-Ht  w^=0 
1  1    2 


) 


a"  '  n>2    w  > 0    w  >  0 


n  =n   w  =C    tj^olP 


The  transitions  which  terminate  intervals  and  start  new  ones  of  the  same  type 

produce  new  values  of  the  supplementary  variable  between  o  and  an  inf initessimal 

even  though  the  probability  is  not  proportional  to  this  infinitessimal.   In 

addition  for  n=n'  in  the  general  case,  two  expressions  overlap  at  w'=w'— o 

and  the  appropriate  probability  is  the  sum  of  the  two  terms. 

It  is  interesting  to  interpret  T  (t)  for  n>2  with  the  elementary  result 

that  the  probability  that  the  second  of  two  events  ends  in  t,t+dt.   Regardless 

of  the  initial  value  of  w  this  is 

,,.  .2  -(A+y)t, 
(A+]j)  te       dt 

The  time  t  must  be  the  sum  of  two  independent  negative  exponentially  distributed 

intervals  each  with  mean  1/(A+jj)  beca  "-.e  in  cum  each  it  the  minimum  of  two 

2 
independent  exponential  variables  with  and  l/\i.      To  see  that  T  (t) 

merely  distributes  this  pri  babilii  tions  to  n'=n,  w'_>0,  w'=0 

and  n*=n,  w'=0,  w'>0  must  be       rated  «  X    to  w"  and  m'     respectively 

J      / —  .L       i- 

over  the  intervals  (o,t) .   This  provides  the  missing  t  values  in  these  terms 
and  together  with  the  two  other  possibilities      .  and  ci'=n+2  the  sum  is 
the  probability  of  two  events. 

Interpreting  the.  entries  of  T"  (t)  as  merely  refinements  of  the  Poisson 

3 
counting  process  is  possible  for  all  states  for  which  n>k.   Consider  T  (t) 

for  n>3 
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/     (v3tV(X+U)tdt)/2 


n>3  w   > 0  w  > 0 

n-3  wr"=w  +t  w  =0 


Ajj    te  dtdw, 


n>3  w   > 0  w  >0 

=n-l   t>w^>0     w.^=0 


T3(t)    = 


2  ,     -(A+y)t :.    ,    - 

I :-w   )e  dl . 


n>3  w  > 0  w?_>0 

r/=n-l  w'=0  t>w">^0 


Ay    (t-w  )e  dtdw. 


n>3  w   >  0  w  > 0 


n  =n-KL   t >w  >0     w  =0 


,    2     -(A+y)t,    ,    - 
Ay   te  dtdw. 


ni^         w  >0         w  >  0 


\      (A3CV(A+1^dtj/2 


n>3    w  >0    w  > 0 


n  =n+3  w  =0    w  =w  +t 


The  calculations  here  are  slightly  more  involved  than  before.   For  example, 
for  n'=n-l,  t>w'>o^  w'=o   it  is  necessary  to  simpli 


J        1  Xpe         1  dt  d 
w*=0 


-<A+y)v 


WW1  Aye-(X+^)(C-Wl-K"  +1i)(V*J> 

w*=0 
1 


d\v' ' 


Again,  integrating  the  supplementary  variables  and  adding  produces 


,,  ,  s?.  2   -(A+y)t  , 
(A+y)  t  e       dt 
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Convergence 

k 
If  the  integrals  defining  the-      Lons  11     are     :  rated  by  parts,  the 

results  are 

.  -• 

H*(t)  =  r   ?*(£)  -  /C  f    T"k-  *  f-T°  I     Is) 
o  o 

The  prime  on  the  functions  indie  tiation  with  respect  to  the  time 

arguement  and  is  justifiable  f/ora  the  definit     of  1      -   function  H  can 

be  given  a  similar  form  as 

H°(t)  =  I  -  fZ    (-T°  (Od£j 
o 

where  I  is  the  identity  function  I(n,w.n^,w')  =  l  Lf  n=n''  and  w=w"  and  0  otherwise 

These  first  of  the  integrals  on  the  right  is  the  joint  probabilities  of  k  or 

more  events  in  (o,t)  and  the  state  at  the  k  Lb  event.   The  second  integral  is 

the  probability  of  k+1  or  more  events  in  (o,t)  and  the  state  of  the  k  th  event. 

From  their  definitions,  the  function  -T   is  equal  to  the  sum  over  the  states 

to  which  a  transition  leads  of  the  function  T  .   If  these  terms-  are.  summed 

over  the  possible  states  at  the  time  of  the  k  th  event,  all  terms  but  I 

cancel  in  ZH  .   The  error  in  the  sum     he  first  m  terms  is  the  probability 

of  m+1  or  mor  .  events  in  (o,t).   This  term  must  go  to  0  for  all  starting  states 

as  m  goes  to  infinity  as  discussed  earlier.   Thus  EH  converges  to  a  function 

which  sums  to  1  for  each  initial  condition. 

Differential  ~£.c\ latio ri 

Notice  that  the  inf initessimal  generator  is  obtained  from  an  operator 
A(dt)  describing  transitions  in  at.  it  can  be  given  a- representation  as 
a  function  A(n,w,n',w  *)dt  and 

T°  *  Adt  =  T^t+dt)  +  T°(t+dt) 


-1 

The  probabilities  of  no  even:.-;  produce  Lnce 
1-"F.  (t+dt+wj       i-K.(t+-v'j  • 

7T    ( j i*.    *    (__ J l_  J  .      h  o<dt) 

jeS  K  1  -   F.(w.)  }     •       1-1  ; 

1  -  F4(t+i                     I  ,    'V  t-Kr  )dt 

i_  _JL_  _   r    -it  =           ,J — ;r4rrr:  O  +  o(dtJ 


=  *   I  -  F  (w  )    "   .  e         1  -  F.O  1  -  F  (t+w  )• 

n  tii?tj 

Similarly  for  small  dt  lo  an  accuracy  of  o(dt) 

I  -  ~ . (t+dt+w  ) 

U(n',w',n,w  +  <t+dt)e  )  h. (t+dt+w. )dt  tt  ^~i"r^~7^~) ~>  = 

n   ]       -1    ieS        i  i 

1 .(t+w,)  1  -  F. (t+w.) 

M<n-,w%n,w+tes  )    Jp  ^  dt   FT   I  L  ..  F  (w  >  )  +  o(dt) 

n  i    ieS       i  i 

J  n 

because  of  the  assumption  of  the  continuity  of  the  interval  densities  as  well 
as  the  continuity  from  the  right  of  the  routing  probabilities.  Applying  A  dt 
to  H  (t)  gives 

HK(t)  *  Adt  =  [fC    Tk(s)*T°(t-s)]  *   Li 
o 

=  /'  Tk(-       i  4-dt  :)  +  T^t+dt-s)] 

=  Hk(tfdt)  -  Tk(t+dt)  4  Tk+1(t+dt)  +  o(dt) 

k  2 

The  error  term  roiues   from  -T  (t-fdt  )  *  T  (o)  which  is  of  order  dt  .   Thus 

the  sums  satisfy 

t     Kk(t)  Adt  •■=   Z  Hk(f+dt)  +  o(dt) 
k=0  k=0 

Thus  these  functions  satisfy  the  differentia]        >     the  transition  pr 
babilities. 
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CO  OD 

Hk(t+dt)   -     E  H   (t) 

,  .     .                t(t)    *    (Adt   -                  .  .    .„                                       £0 
limit  -=      limit      —         ,,-       

i  n 

cjt 


at.  of  the  oris  was  based  on  events 

ten-  of  a  final  subinterval 

thi  p  ocess  symetric  in  that 
I  h  event  then  to  the 
ic-3  the  1st  ar       to  time  C         jh  interval  containing  no 

events.   The  theoretical!  difficult      the  backward  movement  is  the  possibility 

there  is  nc   last  event  in  (o,t)       tius  no  1st  event  for  the  backward 
>rocess   L].   Hei     i  :e  is  no  difficulty  since  there  are  only  a  finite 
of  events  in  any  finite  interval  with  probability  1. 
The  shift  to  thi      ward  approach  is  based  on  simple  properties  of  T 
Lch  are  •'...  ■..  ■•'■>  verifyable  from  their  definitions.   First 

^(t)  =  T°u.)  * 


I  -S  Tk~'(  )  *  '      ■   «  T°(t- 

*  T1^)]     V-s) 

o 

=  '  s) 


[nttoducing  a  new  ;         I    =  T    (0)1    (t)    this   g 


ak  I *  (  t  - s) 
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The  value  of  function  T  (t)  at  (n,w,n',w')  is  the  probability  of  a  transition 
from  n,w,  to  n"",w*  at  time  0  followed  b     Interval  of;  length  1  which  contain:; 
no  event . 

Discrete  Time  Processes 

The  calculational  problem!      his  recursive  structure  are  obvious  as 
is  one  possible  sim]  t)       •    i     Lminate  the 

convolution  operation.   Let 

o 

?vk,  .   r°°  -at  .Tk.  x  , 
K  (a)  =  /  e    H  (t,dt 

In  Laplace  transform  terras  the  recursive  equation  becomes 
Mc   ^k-1   ^1 

^-k   '^k   a->o 
H   =  T   *  T 

k 
Since  it  is  the  sum  of  the  H  which  is  reqt      Lt  is  perhaps  better  to  consi. 

^1   ^1 

S  =  T 

*^k   n-k  J  A-l   n-l 
S  =  S  *  T  +  T 

The  limit  then  satis 
S   *  (I-T  )  -  T 

or 

°"°°       ^1,      ''1  -! 
S   =  T  (I-T  ) 

where  I  is  the  identity  operat 

The  existance  of  the  inverse  can  be  justified  directly  because  |f  |  <  1  [3,  p.  52] 
For  this  one  uses  the  total  variation  as  the  vector  norm  and  then  the  associated 
operator  norm.   This  means  that  in  computing  the  norm  of  i   Lt  is  only  necessary 
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M. 
to   consider  V   *   T      "or   any   probability   measure   V.      On]  >   I)   is    ot:    interest. 

"VL 
For  a  real,   T   (ot)  (n,w,n    ,w  )  U  a  ti     isition   from  n,w,    to 

n',    to  w"*  before  an  exponential   interval    wit!  i  rminates.      Since 

such   a   departure   is  not    certain,    V  .  legative   measure   which   does 

not   sum   to   1. 

The  probability  interpretation  of  the  ;..       transform  can  be  made 

complete  by  considering  T  (a)  as  the  singli      operator  of  a  discrete  time 

Markov  process.   The  process  is  not  conservative  since  at  each  stage  there  is 

positive  probability  that:  the  exponential  interval  terminates  before  an  event 

which  changes  the  value  of  N.   The  limiting  value  a=0  corresponds  to  the 

original  congestion  process  observed  just  after  the  occurance  times  of  the 

events.   Although  these  processes  are  not  chains  in  the  discrete  variable 

as  in  semi-Markov  processes,  they  do  provide  a  major  simplification. 
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